DOCUBBIT BESUHE 



ED 133 804 



TITLE 



INSTITUTION 

PDB DATE 
NOTE 

EDRS PRICE 
DESCRIPTORS 



El 009 023 

Pulfilling the Mission • • • A Program for 
Excellence, Effitlrlency and Effectiveness. Vplune IT« 
Planning — Part I* Research and Evaluation — Part 
••■ II. . • . 

District of Columbia Public Schools, Washington, 
D.C. , ^ V 
Oct 76 / ^ V 

21p. ; For related documents, see EA COS 019*^022 

MF-$0.83 HC-$1.67 Plus Postage. 

Curriculum Development; Elementary Secondary ^ 
Educfation; Evaluation Methods; ^Performance Based 
Education; *Program Descriptions; Program 
Development; *Program Evaluation; *Program 
Planning 

IDENTIFIERS *District o%Columbia Public Schools 

' " • • \ 

ABSTRACT 

This booklet is one of five related publications that 
delineate the program developed by the District of .Columbia Public 
Schools for fulfilling the district's educational mission. The heart 
of this effort is the design and implementation of a districtvide 
competency-based curriculum for the prekindergarten level through 
grade 12, plus the development of attendant organizatdLonal structures 
and planning and evaluation strategies. This particular volume 
consists of two separate parts that foous in turn on the role of the 
district's Division of Planning and on the role of the Division of 
Research and Evaluation. Part 1 reviews the history of the Division 
of planning and briefly outlines its part in the program, and part 2 
briefly discusses six major tasks planned by the Division of Research 
and Evaluation in connc^ction with the program. (J6) 
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MISSION OF THE PUBLIC SdHOOLS 
^ DISJRICT OF COLUMBIA 



To promote excallenca by providing a viable arid cqmprehensive instructional 
program (prekindergarteii through twelfth grade) leading to the attainment of 
knowledge, competend^^and skills which upon completion' will enable each 
student to function as a useful citizen. 
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COMPREHENSIVE PLANNING 



Background 

On November 19, 1975, the Boerd of Education 
gave special attention to planning by identifying it as 
one of the system's major goals.> The need for a central- 
ized planning effort has long been recognized, however, 
budptary constraints have hindered implementation of 
this crucial function. ^ « 



Effective planning can best be carried out by full- 
time planning personnel in conjunction with program 
specialists and developers. For thif^^ason, a Division 
of Planning is being established with personnel whQSe 
primary assignment is that of planning. J 

In mid-January 1976,. a Task Force Pfenning 
was established in the Office of Planning, Res^rch and 
Evaluation and charged with the task of developing a 
planning process model which was completed in March 
1976. This document will i/s^d as a guide in 
initiating planlling activities. 

In April* 1976, the first OireQt^ witb full-time 
responsibility for planning was appointed bn an interim 
basis to head the Division. Existing planning positions, 
some of which were released from the freeze and filled 
some months earlier, were transferred or detailed in May 
creating a Short-Term and Long-Range Ranning Branch 
and a Facilities Planning Branch within the Division of 
Manning. Personnel assigned to the OWision occupied « 
office space in August 1976. 



The Role of the Divtston of Renning and Basic . 
Assumptions 

The Division of^Planning will function essentially 
as' a catalyst for tech no logy based planning activities at 
Various administrative levels.* In performing this func- 
tion, the Division of Planning ytnW coordinate 4)lanning 
activities, conduct the technological aspect of planning, 
and provide technical assistance. This role is based on 
the following assump^l|ps: 

The staffs responsible for implementing and 
executing various elements of the comprehen- 
sive plan will bp responsible for^proposing the 
plans for their progf,0rti ^ 



The responsibility of thp Division of Ranning 
will be to set the basic guidelines for program 
planning; review and. direct adjustment of the 
parts to insure their mutual compatibility and 
review the plans for quality. 

The Division of Ranning will be responsible for 
program and product review for compatibility 
with the long-range goals of the system. 



Dne of the* first tasks to be assumed by the new 
Division of Ranning will be to assess the planning needs 
and resources of the system as a strategy for identifying 
various planning starting points.. It will first rank or 
prioritize system needs as a rationale for initiating plan- 
ning assignments andMhen d^ermine the type- and 
degree of assistance needed, based on system goals, 
results of the needs assessment, and planning priorities. 
Som? projects^ may be advanced simultaneously, while 
others will ba phased. For Sample, the assessment 
might lead to. the identification of crucial problem areas 
such as: \ 

Cun|(Pum - the implementation of a Compe^ 
tency-Based Qurriculum requiring extensive cur- 
riculum revision, test development, and staff 
development. 

Educational Practices - the diffusion, and adop- 
tion of innovative practices fnd the establish- 
ment of systematic evaluation, validetion crite- 
^ ria and procedures for the phased adjtftion of 
innovative practices city-wide. 9 



Services to Children - the coordination and 
improvement of attendance, guidance, and 
other pupil personnel services for all students. 

School Orgaqization the development of 
middle schools, supplementary centers or spe- 
cialized high schools, career development cen- 
ter^ocational hi^h schools, school complexes, 
etc., requiring investigation of various trends 
including facility and personnel needs, student 
interests and needs, eareer and occupational 
demands, educational programs, and projected 
fiscal requirements. ^ 



Planning CapKity - the developmenf^of plan- 
ning capacity through training in planning 
approaches, methods and skills. 

FMilitiai Planning - the -coordination of aduca- 
tipnal program planning with proposed facility 
development, modernization or inlprovement 
and utilization." 



Allocation of Resources - the development of 
policies, procedures and mechenisms to ensure 
equal educational opportunity for all students. 

Profatiional and Community Involvement • the 

development of a process for the ifivblvement 
of teachers, parents, and students in local 
school, regional and system-wide program plaji- 
ning. , ^ 

School Base' Budget^- the analysis of the base 
budget operation in relation to the various 
school populations served, (pre-k to post-secon- 
daiy), the philosophy of the school system, and 
the needs of the community. ^ 

Management Information System - .the assc^- 
ment of Current and projected needs and 
capabilities and the development of a phased 
plan for full implementation. 



Proposed Training Program 

^ In an effort to develop planning capacity in the 
school system through training in planning approaches, 
methods, arlfd skills, a Title IV • Part C proposal has been 
.prepared jointly by the Office of Instruction and the 
, Division of Ranning. Included in the overall (froposal is 
a training program for planners involving central offica^^ 
and regional levial personnel. The training will combine 
theoretical and practical aspects with participants ex- 
ploring and applying planning models, developing and 
conducting a needs assessment, and prioritizing and^ 
generating alternative solutions to identifn|d problems, 
^e major objectives of the trainmg program are: (1) 
to develop a technically competent cadre of planners at 
the central and region^ levels, and (2) to conduct an 
assessment of^^educationaP needs of the community as 
perceiV6?'*Ey students, teachers, parents and adminis; 
trators. ^ 



OOES#^ 

A major product the Division was ''A Design 
for the Deliveiy of Educational Services," developed/|o 
provide a framework for the realignment of central 
admiriistration and a system^wide approach to efficient 
Litili/4tion of educational services and resources. It also 
pro\d^es the vehicle for a coordinated approach to the 
implementation of a Competen6y-Based Curriculum. 
Elements of the Design are: 

■ Outcomes 

■ Instruction 

" Quality Verification and Monitoring 

■ Procurement 
• Information 

■ Interfaces 

■ Personnel and Organization 

Local School Planning 

Two significant procedures have been established 
to facilitate planning at the local schofi] level. The first >^ 
requires the development of an education plan by local 
school staff for each new Or modernized facility. The 
purpose is to ensure that full attention is 'given to 
instruction, organization, facilities and the community. 
The suggested outline for the local school education 
plan follows: 



New or Modernized Facilities 



Instructional Component. / 
' Philosophy or Rationale 
Goals and Objectives 
Curriculum 

Teaching and Learning Strategies 



Mato'riali (ind Equipmant 
Organization Componant 
Studant Population 

4 

Projaction of ... 

. %■ 

Preraquisitas for antry 
^ - Salaction procass 

Adminittrativa and Instructional Staff 
Staffing pattarn 
Rolasand casponsibilitias 
Staff DavalQpmant , 
Facilitias Component- 

. .Description of Existing Facility 
Floor Ran 
Facility Needs ' 

Floof Ran ^ 
Structural modifications ^ 
- - Ground Improvements ^ 
Equipment 

Community Component ^ 
Description of Community and Boundaries 

i 

Survey of Community Resources 

PTAs and/or Home and School Associations 

Community Involvement 

Implement^'tion 



The second planning procedure for local schools 
involves completion of a Local School Data Form and a 
Local School Ran for Education for SY 1970*77. 
These forms . have been completed by all schools, and 
the results are being analyzed. 

In addition, a Staff Development Survey Form 
was sent to each member of the instructional staff In 
order tp identify individual building lavql and system- 
wide staff development needs. The data is currently 
being processed, and will be used in planning staff 
development activities for SY 1976*77. 



MINNION, PRKLIMINARY AND Wf ukH 

♦ ' • ^ . 

Million StiUttf nt: To ikm implement ind monitor a iif lUm wiilo planninK \mm\ (o providf Miiitanco to the 
variouji Hfmontii o( the school systom in tho planninK of pro((ranis and opcraliona; to desiKn, 
implpmrnt and monitor a romprdhrniiivf ttducatlonal (afilitifs plan. 



Prellmlniry Tiiki; lliatod in priority ordrr) 

001 Request ib detail or transfer of appropriate personnel 005 DesiKn plan (or utilization of office space 
to tfie, Division of PlanninK 

' ' 006 Reqaost office supplies, equipment, furniture and telephones 

002 J)evelop mission slatemetit and delineation of tasks ' 

007 Kxecule office space design - including painting and graphics 
. 003 Conduct orientation meeting of personnel assigi^ed to ' ' 

the Division of Planning ' 008 Ro locatf ptirsonnel assigned to th(>,Division of Planning 

004 Develop preliminary organizational structure ^ • 
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Major Tiil^i: I listed in priority orderl 

001 Review and refine the proposed system-wide planning 
process 

002 Develop strategies for the implementation of the 
: process * • 



003 Develop a proposed statement' of philosophy for 
approval by (he SuperintendenCand the.Board of 

^ Education » ' ' ' 

004 Develop jystem objectives which are consistent with 
the philosophy, policies an(| operational strategies of 
the achbol system ' . 

005 Develop a planning needs assessment in order to 
^'identify problem areas 

^)05.1 Conduct an educational program planning survey at 
various system levels, coi^dering: (IJ^personnel , 
invoked in planning; 12) methods a^d strategies; (3) 
^ products; |4) degree of implemeptation; (5) evaluation 
or assessment. 

005.2 Conduct an educational facilities survey considering: " 
' (1) nature and needs of the community; |2) present 
and projected enrollment; (3) Board of Education 
policies and Court mandates; [i] present and pro- 
posed curricula; (5) present and proposed school 
organization; (6) educational and strujitural adequacy^ 



of exislhg fafililies; and (7) projected Capital Outlay 



resources. 



006 Develop a facilities planning process 

007 .Develop a compr^ensive educational facilities plan 

008 Design a staff development program for the implementation 
of system-wide planning process 

009 Implement the staff development program for the 
planning staff 

010 Review and analyze data secured from individual school , 
education plans 



011 Iniprefnent'system-wideplahniog process 

012 Develop a multi-year educational plan ' ^ • 

013 Implement the comprehensive educational facilities plan 
through the facilities planning process . . 



OH Provide assistance to regions^ departments and divisions in 
short ap'd long-range planning ' ' 

OljS Represent the school system in interagency, city-wide and , 
' ' regional planning 
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AN OVERVIEW OF RESEARCH AND EVALUATION ACTIVITIES IN 
^ SUPPORT OF THE PROGRAM FOR 



EXCELLENCE, EFFICIENCY, AND EFFECTIVENESS 



The Division of ^Research and Evaluation has 
identified six major tasks in support of the school 
system's program. Accomplishment of these tasks is 
dependent upon the availability of necessary resources. 
The major tasks are: / 

Impact Evaluation : includes identifying instru- 
ments needed to measure student development 
in relation| to CBC objectives, preparing dn 
impact evaluation desipn, analysis of data, and 
^ reporting results to key decision^makers in a' 
form supportive of program planning and 
redefinition. 

Process Evaluation - includes designing instru- 
mentation to measure the adequacy of program 
implementatiojfi at the classroom and building 
levels, data collection, data analysis, and timely 
reporting of information to decision-ma kehs. 

Research - includes formulizing important re- 
search issues which appear from time to time, 
This task includes designing and implementing 
CBC-related research and reporting findings to 
decision-makers. 

Monitoring/Autfiting - includes the design and 
potential implementation of a monitoring sys- 
tem appropriate at both the central office and 
school building levels. This system will provide 
a means, of reporting accomplishments and^ 
delays in CBC planning and implementation 
processes. 

Statistics - ilTcludes the development of data 
collection forms, issuance of forms, and com- 
pilation of a variety of school system statistics. 
This task will produce tabular and graphic as 
well as analytic 4P interpretative presenta- 
tions. 

Reporting - includes the preparation of mjpnda- 
tory reports from surveys required by Federal 
agencies and bV the Courts. Data will be 
secured from local school units, checked and 
tabulated by the Division of Research and 
Evaluation. 



The following overview presents preliminary plans 
for implementing the above tasks. 

Impact Evaluation - Task 1 

Table 1 presents an illustrative student outcome 
matrix. This matrix is based on the CBC stij dent-related 
objectives. 

Process Evaluation - Task 2 i 

Table 2 displays a process instrumentation matrix 
used in the currently operating Evaluation System in 
thirty-four elementary schools. In order to measure the 
implementation of specific aspects of -educational pro- 
grams such as CBC, additional process data must be 
collected. Appropriate instruments must bd designed 
for this data collection. ' 

Much of the information gathered through the 
Evaluation System approach can'be used for both the 
process and impact evaluation. 

Research - Task 3 

The Research Ta$k includes two distinct com- 
ponents: (1) the Research Information Center, and 
(2) CBC-related research. glThe latter ^activity involves 
conducting research on questions and issues which 
develop during the implementation of the CBC program. 

The purpose of the Research Information Center 
(RIC) is to provide educational research information to 
the school system staff and the community. The RIC 
collects, stores, retrieves, and disseminates irfformation. 
The RIC will conduct computer and manual information 
searches in response to requests. 

In order to conduct educational research relative 
to the Competency-Based Curriculum, staff and re- 
sources must be available. Such a research effort would 
have as its fundamental purpose the acquisition of 
information concerning factors which influence the 
effectiveness of the educational process from pre- 
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kindergarten through grada 12. A rciseareh program 
should begin to validate the most effective instructional 
procedures. / ' 

A review of research on competency-based curric- 
ulum reveals that four di||prent areas of study should be 
investigated in any competency-based educational pro-, 
gram (see Houston 1 974) ^ (1) Documentation Studio 
(2) Practice-Oriented Studies; (3) Policy-Oriented St 
ies; and (4) Basic Research Studies. The follG^ng 
studies should be incorporated in each area: 



J) 



Documentation Studies: Investigation of usa- 
ble case histories on the develojiment and 
implementation of competency-bised curricu- 
lum programs. Among the questions to be 
addressed are: How have such'programs devel- 
oped? What is the organizatfonal smd adminis- 
trative structure of such programs? Hdw are 
teachers trained to teach in such programs? 
(See appendix.) ^ 



oV 



Practice-Oriented Studies: Investigation of 
short-term program effects with developnient 
of measurement instruments to assess this 
adequately; follow-up studies on students in; 
volved in CBC programs. Among the questions 
to be addr^d are: What methods used b'y 
what kinc^s of teachers result in what kinds of 
"progress" as measured by what instruments? 
What competencies, are maintained over what 
time period'by what kinds of students? 

Policy-Oriented Studies: Studies of CBC re:^ 
lated *to the organization and administration; 
research oh selected special aspects: of CBC/ 
Among ^the^ questions to be addressed are: 

V Wh^t changes in staffirrg patterns have been 
necessitated by CBC? What changes in re^urce 

, allocation patterns -have been necessitated by 
CBC? , ^ 

Basic Re»arch Studies: Hypotheses generating 
- studies in field settings. Among the questions 
, to be addressed are: How can teacher respon- 
siveness to students' needs be predicted? What 



student outcomes in the cognitive; affective, 
and psychomotor domains are generated? What 
teaching characteristics are related ^ the "com^ 
petencies" of students? How are minimal com- 
petencies determined? 



Monitoring/Auditing - Task 4 

# • 

Successful implementation of a program depends 
upon a strong ntonitoring system. It is essential that the 
monitoring system include an. organization plan witi^ 
clear simple lines of authority and a comprehensive . 
analysis of the activities to be completed. ^ 

> 

The activities management plan must provide the 
controls and procedures needed to insure a detailed 
understanding of activity specifications, 4)rioritie|, and 
schedules, as well as the capability to recognize delaying 
factors at the eariiest possible moment and provide fcfr 
needed schedule adjustment;. 

Because implementation of an educational 'pro- . 
gram involves all levbis of the school system's operations, 
the project monitorihg system is a key factor in its ^ 
success. Specifically, the monitoring system should be 
capable of: ^ ' 

(1) providing /timely (monthly) reminders to 
middle management as to what is to be done 

^ and by whom. 

(2) exception reports to all division heads con- 

, earning activities which are "off-plan." ^' ' 

(3) periodic roports to the Superintendent's 
Oftice with exceptions noted. 

(4) immediate information on the consequences 
of either missing a milestone or completing 
a task before the scheduled date. 

The monitoring system which has been developed 
possesses the above capabilities. In addition, the docu- 
mentation generated in the process of implementing the 
proposed monitoring system will provide: (1) documen- 



Robert Houston, Educational Competency Assessment, Research, arid Evaluation (Albany, N.Y.: Multi- 
State Consortium on Performance-Based Teacher Education, 1974), pp. 34-53. 



tation of the planning process, (2) step-by-step proce- 
dures for implementing each strategy, (3) continuous 
information to each office Qr division about its respon- 
sibilities, (4) an .'efficient means for each office or 
division to report progress in implementing a program, 
and (5) infq^rmation needed by the Superintendent's 
Office to identify quickly and accurately activities 
\|irfiich ar^e "off-plan." 

/ Jhe bivisioin of Research and Evaluation will have 
the responsibilityjfor auditing thejmplementation of the 
CBC^as well a$ monitoring it. The auditing function will 
involve^ two separate activities: (1) a sample of the 
documentation on activity completion will be reviewed 
by the division of R^earch and Evaluation, and (2) an 
exception report will be generated which will detail 
.activities that are "off-plan." ' ^ 

The objective of the monitoring System is to keep 
the planning and implementation on schedule and to 
assure coordination of related activities. Work quality is 
the concern of the individual offices or divisions. 



Statistics - Task 5 

Every organization requires accurate detailed dat 
on all aspects of its composition and operation. The 
Division of Research and Evaluation designs data collec- 
tion instruments in order to gather factual information 
on students, staff, prograrp«(l schools, and services. 
Statistical reports are developed from these data which 
provide a basis for decision-making at all levels. 

Reports which will continue to be prepared are 
those on student enrollment, attendance, drop-out, 
graduation, and promotion, as well as staffing and 
schools. 

A publication containing statistics and additional 
information will be developed during 1976-77 to pro- 
vide school staff and the community with a readfly 
available source of information about the school system. 




regular District of Columbia budget in ^ny single ele- 
mentary school to within plus or minus tjve percent of 
the citywide^erage. This Court Decrefe is still in effect. 
The task ofcarrying out all of the procedures to assure 
compliance has been the responsibility of the Division 
of Research and Evaluation. The Division Will continue 
to collect' and process data and make necessary adjust- 
ments in consultation with appropriate administrators 
in order to bring about compliance with the , Decree. A 
^^comprehensive report, as required by the Court Drder, 
" will be developed and submitted to the Court. 

Another report required by law is the. Titie I 
Co;nparability Report. In order to receive ESEA Title I 
funds, the school system must show that it is providing 
. comparable services to all its schools with state and local 
funds. Data for comparability purposes must be 
collected and processed^for each school. Adjustments 
must then be made in order to effect compliance. The 
final comparability report must be submitted to the U.S. 
Dffice of Education 'by^December 31 qf each year. The 
Equalization and Comparability tasks will continue to 
be clor^ly coordinated in order to minimize disruption 
of teaching services in local school classrooms. 

Other mandatory reports for 1976-77 are the 
Imports of th& Civil, Rights Survey ahd the Equal Em- 
ployment Dpportunity Commission Survey. Both of 
these surveys require dat^ from each of the 196 public 
schools. The Division will gather, check, and compile 
the data; prepare reports; and forward them to the 
appropriate agencies. Also^the U.S. Dffice of Education 
required annually the Elementary-Secondary General 
Information System Survey. This 5-part survey requests 
information on staffing,* enrollment, finances, atten- 
dance, school operations and facilities, and expenditures. 



The accomplishment of these six major tasks will 
help ensure the generation and reporting of accurate and 
timely information to decision-makers who are responsi- 
ble for the improvement of educational programs'and 
services. 



Reporting - Task 6 

' The U.S, District Court of the District of Colum- 
bia on May 25, 1971 ordered the Public Schools of the 
District of Columbia to equalize tite per'pupil expendi- 
ture for all teachers' salaries and benefits from the 
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I. The oulcome domiiu hive been/levdoped frorthe 
list of CBC student objective! These doinii&i shoiild 
not be considered is eihiuiim of the fiill nnge of 
desiretl tttident-outoomes, ilth^igh they ire highly 
repttsentitht. ^ 

J. Instruments nimed^n the mttrii ire illtislriiive of 
'the types of ineisurt/thit could be used. For the 
purpose of eitiinitlng Reskircfa ind GviIuitioQ r^ 
source requiranents, checkpoints were set it grides 
K, 3, (, 9. and 12. It b inddpited tliit considerible 
' plunifig will be lieeded belon Ihe Unil checkpoints 
CIO. be established. | 

3. Miips ^' single roo^ importult fictof in the pto< ' 
poied LipMt eviluitkm ded^ that i baseline data 

'^ank be establish^ in 1^6-77,|t)r issoonas possible. 
s(^ that the impact of the CBC program can be, 
assessed in subsequent yeart ' ' , 
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ELUSTRATIVE PROCESS INSTRUMENTATION MATRIX 



'Sludent Reading Form (1200 - See 
Allochment) ' 



'Qassroom Background Eorm (I2D2 
See Attachment) 



*Teocher Data Forn! (1101- 
^ SeeAttachmenl) 



•Student Dola Form (llOO-See 
Attainment) 



"Program Information Form ^ 



Description of Current (]$e , 

Presently ImplemenlecJ in the W$choo|s 
participoting'in the Evalubtion Syslem, 
Addilionql resources are required lo 
extend the use of the Evaluation System , 
to all^ublic schools, 

Presently impl^/^ented in the 34 schoqis 
porti^ipoiing in Ihe Evaluation System. 
Additional resources are required to 
exjend ihe useff the Evaluation System 
toall public schools. « 

Presently implemented in the 34 schools 
porlicipoling in the Evaluation Systerrf/ 
Additional resources ore required to 
extend the use of ihe Evaluation System > 
to all public schools. 

Presently implemented in ihe 34^schools , 
porticipating in the Evaluolion System, 
Additional resourcesore required to 
extend the use of the Evoluolion Istem 
to all public schools, \ 



Notes 

,1. The first four instruments mentioned in the 
motrix provide a core«f process information 

: which can support theproposed CJBC process 
' evaluation deslgn. Addilional items of informa- 
tion dnd. perhaps additional forms will he 
needed to capture CBC specific process data, noi 
already collected by these four instruments. 
Examples of such data items include information 
on staff development and CBC instructional 
materials; equipment and facilities. 



2. A bose!ine of process data should be establisVed 
in 1976-1977 so that the changes in instructionol 
tflXocess engendered by the CBC progfonfi can be 
evaluQied. ' ^ 



'Instruments currently in use 
"Instruments suggested for 1976-1977 



